Ultrametricity in the Edwards-Anderson Model 
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agreement with the prediction of the mean field theory. Since ultrametricity is not compatible with 
a trivial structure of the overlap distribution our result contradicts the droplet theory. 



in 



S3 
S3 



T3 

S3 
O 



- 1—1 

x 



We test the property of ultrametricity for the spin glass three-dimensional Edwards- Anderson 
model in zero magnetic field with numerical simulations up to 20 3 spins. We find an excellent 
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Ultrametricity is a widely accepted property of the mean field spin glass theory: it is a crucial ingredient in the field 
theoretical computations of the Sherrington-Kirkpatrick model 0, d, 0] as well as a guiding principle for the rigorous 
proof of its free energy density formula Its relevance in finite dimensional systems is nonetheless still an open 

matter, subject of intense investigations and debates in the theoretical and mathematical physics communities. 

Ultrametricity states a very striking property for a physical system: essentially it says that the equilibrium configu- 
rations of a large system can be classified in a taxonomic (hierarchical) way (as animal in different taxa): configurations 
q ■ are grouped in states, states are grouped in families, families are grouped in superfamilies. This equilibrium ultra- 
'— 1 , metricity has a correspondence in the existence of widely separated time scales in the dynamics, typically of a glassy 
system. 

It is not clear at the present moment if ultrametricity is present in three dimensional systems; the most studied 
\Q • case is three dimensional spin glasses where contrasting results have been presented in the literature in the last twenty 
r*"** \ years. Part of the difficulties arise from the fact that ultrametricity should be, at the best, exact when the volume of 
the system goes to infinity and therefore simulations done on a limited range of volume are difficult to interpret. In 
this letter we study systems ranging from 4 3 to 20 3 extending of about an order of magnitude the range of volume 

■ used in previous simulations. 

From the technical point of view ultrametricity implies that sampling three configurations independently with 
respect to their common Boltzmann-Gibbs state and averaging over the disorder, the distribution of the distances 
among them is supported, in the limit of very large systems, only on equilateral and isosceles triangles with no scalene 

■ triangles contribution. In a generic situation the relative weight of equilateral and isosceles triangles is arbitrary, 
however it is well established in stochastically stable systems; the stochastic stability property was introduced for the 
infinite range spin glass model in 0, [i| and later proved also for the realistic short ranged models in finite dimensions 

The property of ultrametricity and the non-trivial structure of the overlap distribution are the characterizing 
features of the mean field picture and are mutually intertwined: a trivial (delta-like) overlap probability distribution, 
like the one predicted in the droplet theory [11] . is not compatible in fact with the previous ultrametric structure 
because it predicts only equilateral triangles all of the same side. 

In this letter we study the Edwards- Anderson model [13] for the spin glass in the three-dimensional cubic lattice 
with ±J random interactions (for a numerical study in four dimensions see [HI]). With a multi-spin coding and a 
parallel-tempering algorithm we numerically investigate the distribution of the overlaps: all the parameters used in 
the simulations are reported in TabQ] We have checked the thermalization by verifying that our result would have 
been the same (inside our small error bar) by taking simulations a factor 4 shorter. 

We find very strong indication in favor of ultrametricity which turns out to be reached at large volumes with exactly 
the form predicted by the mean field theory and, by consequence, a robust signal against droplet theory (for a study 



of dynamical ultrametricity and for the relation between statics and dynamics in spin glasses see 1J, [15|). According 
to the literature the system has a transition T c of 1.15 and our data are compatible with this value. The smallest 
temperature we used is 0.7, i.e. about 0.6T C : although we are relatively far from the critical temperature, we may 
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Table I: Parameters of the simulations: system size, number of sweeps, number of disorder realizations, number of temperature 
values allowed in the parallel tempering procedure, minimum and maximum temperature values. 



still feel some effects coming from the critical region. However we notice that ultrametricity should not be valid at 
the critical temperature, consistent with our results, so any finding of ultrametricity at lower temperature cannot be 
an artifact. 

From a mathematical point of view the triple (01,2,02,3,03,1), with < Cj,j < 1, representing the overlaps among 
three copies of the system, is called stochastically stable and ultrametric when, defining x(c) = J P{c')dc' , where P(c) 
is the probability distribution of c, its joint probability distribution function has the following structure: 



f3(ci,2, C2,3, C3,l) = ^-P(C1,2)X(C1,2)£(C1,2 ~ C 2 ^)5(c 2 ,3 ~ C 3 ,l) 



(1) 



2 P ( Cl ' 2)-P(c2,3)0(ci, 2 - C 2 , 3 )5(c 2 ,3 ~ C 3 ,i) 



+ 2- P ( C 2,3)-P(c3,l)^(c2,3 - C 3 ,l)5(c 3) l - Ci, 2 ) 



+ 2- p ( c 3,i)-P(ci, 2 )^(c3,i - Ci, 2 )<5(ci,2 - C 2:3 ) • 

Thinking of the quantities c's as 1 minus the sides of a triangle the previous formula says that only equilateral 
(first term on the right hand side of eq. |JT])) and isosceles (last three terms of eq. ([T])) triangles are allowed, the 
scalene triangles have zero probability. Equation ([1]) implies that the distribution of the three random variables 
u = min(ci, 2 , c 2 ,3, 03,1), v = med(ci >2 , c 2:3 , c 3 ,i) and z = max(ci j2 , c 2 , 3 , c 3 ,i) is 



1 3 

p(u, v, z) — — x(u)P(u)5(v — u)6(z — v) + —P(z)P(v)9(z — v)5(v — u) , 

and from that one deduces that the distribution of the two differences x = v — u, y ~ z — v is 



(2) 



p(x,y) = 6(x) 



\s(y) + |%) / Plain „-,/),/„ 



(3) 



whose marginals are 



p{x) = 5{x) 



p(y) = \&{y) + \o{y) I pudpui - nxu, . 



(4) 
(5) 



We recall that the Hamiltonian of the EA model [12j is given by 

H„ = 



Jij< J i°~j 
|i-j|=l 



(6) 
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with Ji j — ±1 symmetrically distributed and Ising spins ai = ±1. Given two spin configurations a and r for a system 
of linear size L, we consider the main observables: the link-overlap 

Q(a,r) = (3L 3 )- 1 ^ ^o^t.tj (7) 
l<-j|=l 

which is the normalized Hamiltonian covariance, and the standard overlap 

(Z (a,r) = ( J L 3 )- 1 ^ ( r l r l (8) 

i 

which is related to the Edwards- Anderson order parameter. For every function of two spin configurations c(cr, r) (for 
instance Q or q) the physical model induces a probability distribution by the formula 

7Mci,2, C 2 ,3, C 3 ,l) = (<*(C1,2 - C(<7, r))<S(c 2 ,3 ~ c(t, 7))<S(c 3 ,i - 0(7, cr))) , (9) 

where cr, r, 7 denote three different equilibrium configurations. Here and in the sequel the brackets (•} will denote the 
average over the disorder Jij of the thermal average over the Boltzmann-Gibbs distribution. 

We will find very strong evidences that for large volumes the link overlap has the ultrametric structure of eq. (fTj). 
(we are in zero magnetic field and the system is invariant under a global change of all the spins). As we shall see at 
the end of the paper the same results are valid also for the standard overlap with the only difference that it has a 
symmetric distribution in the interval [—1, 1] and the triangle distribution is built on it by suitable contributions of 
the positive and negative values, see formula (TIT)]) below. 

We present firstly the results for the link overlap for two reasons: the analysis is conceptually simpler, the link overlap 
is more fundamental than the standard overlap and contains more interesting information, e.g. two configurations 
that differ by a spin inversion of a compact region of size half of the lattice, will have, in the infinite volume limit, a 
zero standard overlap, but a large link overlap. 

The results can be described as follows. We test numerically the structure of the distribution for the two random 
variables X = Q m ed — Qmin and Y — Qmax — Qmed where the Q's represent the largest, medium, and smaller value 
of the link-overlap among three copies of the system. The numerical data are compared to the formulas ((4| and ([5|). 

• Figure 1: We find that the variances of the two variables have a totally different behavior. The left panel 
contains the plot of Var(X)/Var(Q) and the right panel of Var(Y) /Var(Q) both as a function of Var(Q). We 
find more convenient this parametrization with respect to the usual one using temperature because it allows to 
extract more information on size dependence through scaling laws: this is due to the fact that V ar{X) ,V ar(Y) 
and Var(Q) have size dependence changing with T. In particular within the temperature range that we have 
taken into account the quantity Var(Q) decreases monotonically with the temperature. The figure clearly shows 
that while the variance of X is shrinking to zero the variance of Y is growing with the volume. Moreover the 
variance of X satisfy a scaling law with very good accuracy: Var(X) /Var(Q) scales like L -118 (see inset) while 
there is no scaling law for the second variable. 

• Figure 2: The figure displays for two system sizes of L = 12 and L = 20 the data histograms for X (in black) and 
Y (in red) variable at T = 0.7. They show that V(X), the empirical distribution of X, is much more concentrated 
close to zero, while V(Y) is spread on a larger scale. The function p{Y) provides a test of consistency with 
formula (O . The plot of /5(F) has been obtained using the data histograms of X to represent the delta function 
(HJ) and the experimental data for the distribution of Q inside the convolution. The two curves superimpose 
each other with an excellent agreement. We have also tested that any different numerical weight other than 1/4 
and 3/4 do not yield such an agreement. 

The previous results clearly show that the link overlap has an ultrametric distribution. Our next investigation is 
about the standard overlap for which we find that it also obeys ultrametricity. Given the three standard overlaps 
91,2)92,3)93,1 their probability measure is a priori supported on [— 1,1] 3 . Reflection invariance (q it j — > a^qi^aj, with 
a = ±1) implies that it is a sum of two orbits, one for S = sign(g 12 52, 393.1) > and the other for S < 0. The mean 
field theory predicts that only non-frustrated triples (S > 0) contribute to the triangle distribution, namely: 

^3(91,2, 92,3, 93,l) = I [-£3(91,2, 92,3, 93,l)0 (9l,2)%2,3)%3,l) + Pa(-Ql,2, "92,3, 93,l)0(-9l,2)0(-92,3)#(93,l) (10) 



+-P3(9l,2, -92,3, -93, 1)0(91, 2)#(-92,3)6'(-93,l) + ^(-91,2, 92,3, -93,l)#(-9l,2)%2,3)#(-93,l)] 
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To check the validity of the previous formula it is convenient to introduce the new random variables 

q m ax = max(|gi l2 |, |Q2,3|, |<73,l|) (U) 

q m ed = med(|gi )2 |, | ^2 , 3 1 - ks,i\) ( 12 ) 

?mm = sign(gi i2 g 2 ,393,i) m i n (ki,2|, \q2, 3I, |?3,il) ( 13 ) 

and verify that their distribution is the fl}. The numerical results are illustrated in Fig 3: the left panel shows how the 
normalized variance of the variable x — q me d — q~min has a clear tendency to vanish for temperatures below the critical 
point. The inset displays the log-log plot of Var(x)/Var(\q\) as a function of L at the lowest available temperature 
T = 0.7. At the critical point the quantity is instead size invariant as predicted by the mean held theory. A totally 
different behavior is found for the variable y — q max — q m ed where below the critical temperature the normalized 
variance is increasing but still size invariant at criticality. 

We have also explicitly investigated the contribution of the frustrated triples by plotting the quantity S^' = 
/_! dq m inP(q m in)qliin/ I-i dqminP(qmin)q'? n ini where p(q min ) is the probability distribution of q mm : the left panel of 
Fig. 4 clearly shows that the distribution of q m i n is supported almost completely on the positive interval and that the 
negative values are concentrated near zero (for similar quantities and other three-replicas observables see (l6j). This 
implies that the contribution associated to the frustrated orbit (S < 0) is very small at large volumes. 

The equivalent behavior of link and standard overlap is indeed expected because it extends previous findings of 
17, TH where it was shown that link and standard overlaps are mutually non fluctuating for the case of Gaussian 



couplings. In the right panel of Fig. 4 we show, for the model with ± J investigated within this work, the analysis 
of the relative fluctuation and functional dependence of the two overlaps. It is shown the function G(q 2 ) — (Q\q 2 ), 
i.e. the expected value of the link-overlap for an assigned value of the standard overlap, for different system sizes at 
T = 0.7, with a fit to the infinite volume limit <?oo(<7 2 ). The conditional variance of Q given g 2 , displayed in the inset, 
shows a trend toward a vanishing value for infinite system sizes. 

Numerical simulations, like the Delphi Oracle for Heraclitus, neither conceal nor reveal the truth, but only hint at 
it. In this work we have investigated the property of ultrametricity in a short-range spin-glass model. We have shown 
that violations of ultrametricity in finite volumes have a clear tendency to vanish as the system size increases. We 
verified moreover that the analytical predictions of the ultrametric replica symmetry breaking ansatz are correct up 
to the tested sizes. Our results contradict previous finding [191 ] done for much smaller volumes (up to 8 3 ) in which 
lack of ultrametricity was claimed. We have shown instead strong numerical evidence that the spin glass in three 
dimensions fulfills the property of ultrametricity for both the link and the standard overlap distributions. A detailed 
account of the present investigation will appear elsewhere [IS] . 
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function of Var(Q). The inset (at left) shows the scaling law for a = 1.18, i.e. L a Var(X)/Var(Q) is L-independent. 




Figure 2: Empirical distributions V(X) and V(Y) for X = Qmed ~ Qmin and Y = Qmax — Qmed for the two system sizes 
(L — 12 and L — 20) at temperature T = 0.7. p(Y) shows the distribution of Y computed from formula ((5J using experimental 
data for V(Q) and approximating the delta function with the histogram of X 
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Figure 3: Normalized variances of the two random variables x = q m ed — Qmin (left) and y = q ma x — q m ed (right) as a function 
of the temperature. The inset (at left) shows the Independence of Var(x)/Var(\q\) at fixed temperature T — 0.7 on a log-log 
scale together with the best fit: Var(x)/Var(\q\) ~ aL b , a = 0.12, b — —0.23. 
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Figure 4: Left panel: the average value of S^~' (defined in the text) as a function of T. Right panel: Conditional expectation 
(Q\q 2 ) and conditional variance yar(Q|g 2 )(inset) of the random variable Q given q 2 , where Q is the link-overlap and q 2 is the 
square of the standard overlap, for different system sizes at temperature T = 0.7 



